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Abstract: We present a coherent approach to the competition between thermodynamic 
states in spatially inhomogeneous systems, such as the Edwards-Anderson spin glass with 
a fixed coupling realization. This approach explains and relates chaotic size dependence, 
"dispersal of the metastate", and for replicas: non-independence, symmetry breaking, and 
overlap (non-) self- averaging. 

The connection between the existence of many thermodynamic states and the phenomena 
of non-self-averaging (NSA) and replica symmetry breaking (RSB) has long been a central 
topic of research in disordered systems. These phenomena play a key role in Parisi's solution 

0, ^ of the infinite-ranged Sherrington-Kirkpatrick (SK) Ising spin glass model Q], and 
have been discussed in many other contexts, e.g., short-ranged spin glasses f^, random 
field XY models |^, random manifolds M, heteropolymers H, and impure superconductors 



in magnetic fields |T^. Another aspect of the competition between thermodynamic states, 
introduced by the authors in Ref. |TT[, is "chaotic size dependence" (CSD) which, unlike 
NSA, manifests itself for a fixed realization of the disorder. 

An important issue is whether (and in what sense) the many novel features of Parisi's 
solution can apply to more realistic models, such as the Edwards-Anderson (EA) nearest- 
neighbor Ising spin glass ||12| . In a previous paper |jl3l , it was shown that this "SK picture" , 
as conventionally understood, is not valid. In particular, the overlaps of the thermodynamic 
states for coupling realization J' do not depend on J'. This leads us to approach all ba- 
sic phenomena as accessible for a fixed realization. Although we focus here on disordered 
systems, this approach is applicable to the more general setting of inhomogeneous systems. 

We shall see that CSD is one aspect of a phenomenon, "dispersal of the metastate", 
which is closely connected with both NSA and RSB. The metastate is a natural ensemble, 
i.e., a probability measure, on the (pure or mixed) thermodynamic states of the system 
TM. At high temperature, it is a 5-function on a single state; we call this a non-dispersed 
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metastate. CSD will occur if the metastate ceases to be a single ^-function; we call this a 
dispersed metastate. It will become apparent below, but we emphasize now, that dispersal 
of the metastate is not the same as the mere existence of many states. One unfamiliar but 
essential feature of our approach is a replacement for the usual notion of NSA; we shall see 
that (unlike the standard SK picture) replica overlap fluctuations (if they occur) are due not 
to explicit J -dependence hut rather to state- dependence within the metastate for fixed J . 

We also find further connections between the structure of the metastate and that of the 
replicas: dispersal of the metastate is equivalent to replica non-independence (RNI), to be 
explained below, while RSB is equivalent to the individual states in the metastate being 
mixtures (of pure states). 

CSD and the metastate. — A thermodynamic state F of a system such as the EA model 
at temperature T with fixed J (we take zero magnetic field) is in general a mixture of pure 
(extremal) states. If there are many pure states, e.g., as predicted by the SK picture ||15[, CSD 
could occur |TT|. This would mean that for finite volume Gibbs states with jT-independent 



boundary conditions, such as p^^^ (with periodic b.c.'s on the L'^ cube A^, centered at the 
origin), the correlations (cTj^ . . .crj,^)^, will have no single limit as L ^ cxd but rather many 
different limits along different subsequences of L's. 

Such behavior in L is analogous to chaotic behavior in time t along the orbit of a dynam- 
ical system. In both cases, the dependence of the state (on L or t) is actually deterministic 
but appears to be a random sampling from some distribution k on the space of states. For 
inhomogeneous or disordered systems, k is a metastate, i.e., a probability measure on the 
space of all (fixed JT) thermodynamic states, and is the limit of k^,, a "microcanonical" en- 
semble in which each of the finite volume states p'-^-*, . . . , p'^^^ has weight L^^ . The meaning 
of the limit is that for every (nice) function g on states (i.e., a function of finitely many 
correlations), 

iimL-^X:^?(p^'^) = Mr)}. • (1) 

i-°o £=1 

Here, the bracket denotes the average over k. 

What are some possibilities for the metastate k in the EA model? If there is a unique 
thermodynamic state there is no CSD and k is not dispersed - it is a (5-function on that 
state. If (as in the Fisher-Huse (FH) droplet picture of the spin glass phase |jl6|, |T^) there 



is only a pair of pure states, related by a global spin flip, then k is a 5-function on the 
equal-weight mixture of these two states; there is still no CSD and no dispersal of k, even 
though the pure states break spin flip symmetry. On the other hand, a dispersed metastate 
would result if the periodic b.c.'s in Eq. (p were replaced by, say, plus b.c.'s - namely, the 
equal-weight sum of the two 5-functions on each of the two pure states. The CSD yielding 
this metastate simply corresponds to the strong preference, for most large L's, of plus b.c.'s 
for one or the other (chaotically depending on L) of the two pure states. The possibilities 
in the EA model if there are many pure states will be discussed later; these include both 
dispersed and non-dispersed metastates. 

What is NSA ? — For disordered systems, there is an alternate construction of metastates. 
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due to Aizenman and Wehr [|I^. The microcanonical ensemble kl is replaced by the ensemble 
of states on Al obtained by varying the couplings outside Al. The limit here means that for 
every (nice) function F of finitely many couplings and finitely many correlations, 

hm [FiJ,p^^'%, = [{F(J,r)},(^)] . (2) 

Here, [.]av denotes the average over the (quenched) disorder distribution u. The limit exists, 
for subsequences of L"s, and the resulting k(J7') is a fixed- JT" metastate [Q. It can be shown 



(we will present a proof elsewhere) that for subsequences of ts and L's, the limit in Eq. (||) 
exists and yields the same k{J'). In both limits, the subsequences are JT"- independent. We 
conjecture that actually all subsequences yield the same limiting k(J7'), which would then 
be the periodic b.c. metastate. For a different b.c, such as plus, there could be a different 
metastate, as noted above. 

When F is chosen so as to fix the value of all couplings inside and then L ^ oo, the 
RHS of Eq. (0) reduces to that of Eq. ([1|). Averaging over k for fixed J' thus corresponds 
to averaging over the "couplings at infinity". In realistic systems, thermodynamic state 
observables can depend on the bulk couplings and/or on the couplings at infinity. Thus 
we suggest that there are two distinct types of dependence: (i) on J , and (ii) on the state 
r within the metastate k for fixed J . We shall see that replica overlaps cannot have the 
first type of dependence, but can in principle have the second kind. If overlap fluctuations 



(over the couplings) don't vanish as L ^ oo |T8|, this is a signal that the second kind of 
dependence holds for infinite volume. 

Replica Non-Independence — Suppose the functions F[J,p) in the LHS of Eq. (^ are 
restricted to be linear in p, i.e., of the form {f{J', <y))p. These determine a limit for the finite 
volume pair (JT''-^^ cr^^^), where J^^'' is the restriction of J to A^ and a(^) is distributed 
by p^^\ The limiting joint distribution is of the form i'{J)pj{cr) with pj- a fixed- ^7 ther- 
modynamic state |13, 19|, which is simply the mean state (or barycenter) of |jl4| - 
i.e., 



(^im) PJ = {{(^il ■ ■ ■ (^iJt] ^(^J) ■ (3) 



Guerra has pointed out an important extension of this construction of pj. Take un- 
coupled (but identical) Hamiltonians for infinitely many replicas in finite volume. 
This replaces p^^^(cT^^^) by the product measure p^^\a^^^^) p^^\a'^^^^) . . ., and leads to a lim- 
iting joint distribution for {J^^\a^^^\ a'^^^\ . . .) of the form h'{J)pj{a^, cx^, . . .). Guerra 
further noted that nonvanishing of overlap fluctuations (as L oo) should imply the non- 
interchangeability of taking (a) replicas and (b) the thermodynamic limit: pj would not 
equal the product pj{(J^)pj{o'^) ■ ■ ., but rather some mixture of products. In this case, one 
would have a Gibbs state py for the uncoupled replica Hamiltonians which is not simply 
the product of Gibbs states for the individual ones. The cr^'s in such a pj would not be 
independent, but would be coupled implicitly through "boundary conditions at infinity". We 
call this non-independence among replicas RNI. 

We raise two additional points here. The first is that replicas and the "replica state" pj 
naturally follow (like pj) from the construction of the metastate The second is that 
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RNI is equivalent to dispersal of the metastate k since the product decomposition of py is as 
a mixture over k: 

py{a\a\...) = {T{a')T{a')...}^^j) . (4) 

Both points can be explained in terms of "metacorrelations" . Like the usual correlations, 
((jyi)r (where aA denotes cTjj . . . cTj^ for the set A = {ii, . . . ,im}), these are generalized 
moments of arbitrary order m and they characterize k: 

{9iT)}, = {{aA,)r...{aAjr}. • (5) 

Restricting to m = 1 such ^f's in Eq. ([l|) (or the corresponding F's in Eq. (|^)) yields pj 
as explained above. Restricting to m < 2 such g's or F's yields the two-replica measure 
Pj{a^,a^) (corresponding to "integrating out" all the other replicas in py), etc. Thus for 
any m, the correlation {(t\^ . . . cr'^J) evaluated in py equals the LHS of Eq. (^ evaluated in 
K,{J). This proves Eq. @). 

Eq. (^) shows that RNI and RSB are distinct phenomena and either one can occur 
without the other. The former corresponds to a dispersal of k over multiple F's, the latter 
to an individual V being a mixture of multiple pure states. 



Overlaps. — A basic construct in Parisi's solution |T5| of the SK model is the overlap 
distribution. For configurations cr, a' on all space, the overlap should be defined as 

Q((T,a') = lim L-'' ^ a^a', . (6) 



L 



Its distribution depends of course on how a and a' are chosen. If they are independently 
chosen from pure states fl^, labelled a and /?, then cr^cr^ in Eq. (^ may be replaced by 



{o'x)a{o''x) 13, and Q = g"^ with distribution 6{q — g"^). In the standard SK picture, a and a' 
are chosen from the product measure Pj{o')pj{a'). Ref. |]13[ proved that this picture is not 



valid for realistic models because the resulting overlap distribution does not depend on J^. 
However, Guerra's work ||2^ and that of the previous section indicate that the standard 



SK picture should be replaced by one where a and a' (and other replicas) are taken from 
Pj. Before we discuss various features of this nonstandard SK picture, we will now see that 
the overlap structure still does not depend on J . 

The overall overlap structure, given here by the (joint) distribution Py for overlaps, 
Q^^ = Q{a^,a^), between all pairs of replicas, contains much information. The simplest 
piece of information is the (marginal) distribution of a single overlap, say g^^; by Eq. (^), this 
equals {Pr{(l^^)}n{j), where Pr{q) denotes the overlap distribution coming from T{a)T{a'). 
More generally, the distribution for Q^^, Q^"^, Q^^, ... is 

Py{q'\q'\...) = {Pr{q'')Pr{q'')...}.iJ) • (7) 

This shows that Pj can encode considerable information about the jT-dependent metastate 
K, at least if different F's from k yield distinct Pp's. Nevertheless, Pj (and hence Py) does 
not depend on J'. The proof is essentially the same as that given in Ref. |jl3|. 
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Scenarios for the EA metastate. — We previously discussed the two possibilities for the 
EA model that the (periodic b.c.) metastate k is 1) a 5-function on a single pure state or 2) 
a 5-function on a mixture of two pure states. If there are many pure states, other scenarios 
are possible. In all of these it is convenient to imagine that for large L, p(^) is approximately 
a mixture, WlP°'^ of pure thermodynamic states labelled by a (we suppress the fixed- JT" 
subscript in this section); the scenarios differ in how the weights depend on a and L. 
Note that (for periodic b.c.'s) the ordered (i.e., with broken spin flip symmetry) pure states 
always come in pairs with W^"' = W^. 

One scenario is that Wl = maXa{Wj^ + W£°') as L —* oo. Then each state F from 
K should have an integral (rather than sum) decomposition, F = J Wr{<y)p°'da. There are 
then two possibilities, both of which exhibit RSB: either 3) there is no CSD (or RNI) and k 
is a 5-function on a single such F or 4) there is CSD (and RNI) and k is a dispersed measure 
over many such F's (and Wr{(y)^s). Both possibilities would be quite unlike either the SK or 
FH pictures; competition between pure states would be so well matched that for most large 
L's, no group of a few states dominates. 

On the other extreme is the scenario where Wl — > 1 as L ^ oo (we assume here that 
every p° is ordered). This could occur without CSD (or RNI), which leads back to possibility 
2, or else 5) there is CSD (and RNI) and n is dispersed over many F's, each of the form 
[p"+p~"]/2. This latter possibility is an intriguing revision of the FH picture; the competition 
between pure states would be so mismatched that for most large L's, a single pair of states 
would dominate, but which pair would depend chaotically on L. Possibility 5 actually does 
occur in the ground state structure of a short-ranged, highly disordered spin glass model 
in high dimensions (while possibility 2 applies in low dimensions) Indeed, for the EA 
model itself at T = (with a continuous distribution, such as Gaussian, for the individual 
couplings), only possibilities 2 or 5 can occur. We remark that in the plus b.c. version of 
possibility 5, there would be RNI but no RSB. 

The nonstandard SK picture corresponds to an intermediate scenario where tends 
neither to zero nor to one and most of the weight is concentrated on a few pure states, 
with the choice of states depending chaotically on L. In this possibility 6), there is CSD 
(and RNI) and k is a dispersed measure over many F's, each with a sum decomposition, 
F = J2a W^p"', so there is also (nontrivial) RSB. Such a F immediately yields the (fixed-F) 
overlap distribution 

^r(g) = EW^rW^r%-rt • (8) 

The key objects of this picture are the Pr's and their average over k, P = {Prjfi- As 
noted, dependence on J' and averaging over z/ in the standard SK picture are replaced by 
dependence on F and averaging over k. The basic requirements of this nonstandard SK 
picture are as follows: The fixed-F distribution Pr{q) should be a countable sum of (many) 
5-functions. This is a prerequisite for (nontrivial) ultrametricity within F, which is the second 
requirement. The third requirement is that the averaged distribution P{q) be continuous 
between two 5-functions at :tqEA- We remark that the first and third requirements cannot 
both be vahd unless Pr really does depend on F. 
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The nonstandard SK picture is the only way in which some famihar aspects of mean-field 
behavior can survive in the EA model, but it is not clear to us whether this picture is in fact 
valid in some dimensions at some temperatures. We do know that the overlap structure has 
no jT-dependence in both the standard and nonstandard SK pictures. This ruled out the 



standard picture |]T3|; we now pursue some implications for the nonstandard picture. 

In addition to translation-covariance, the metastate i^{J) is covariant with respect to 
changes Aif of finitely many couplings (see Eq. (5.3) of Ref. |]14|)- Under such changes, 
pure states remain pure and the pure state overlaps g"^ do not change at all. However, 
the weights W^-, which appear in Eq. (|^), will in general change. The overlap structure of 
Eq. (1^ yields a measure on the set of weights appearing in the Pr(?)'s for each fixed set of 
possible g"^'s and by the lack of ^/-dependence, each of these measures must be invariant 
under the change in weights created by every such AH . It is unclear whether the enormous 
number of constraints this imposes can be satisfied. 

Discussion and conclusions. — For fixed J , a metastate k = i^{J) is a probability 
measure on the fixed-T thermodynamic states F of the system. The F's can a priori be pure 



or mixed. For disordered systems, metastates were constructed by Aizenman and Wehr |14 



by means of the ensemble of "couplings at infinity". The average {F}k(j') over this metastate 



is the state pj (independently constructed in [|19]) used in [|T3l to rule out the standard SK 
picture for the EA model. 

In this paper, we constructed the same metastate k, but by means of the ensemble of 
finite volume states p^^^ for a fixed J , so that our approach can be applied to inhomogeneous 
systems in general. Dispersal of if it occurs, implies chaotic size dependence of p^^-*. 
Furthermore, replica symmetry breaking is equivalent to the appearance of mixed states F 
in /€, while dispersal of k is equivalent to replica non-independence (as introduced by Guerra 



We then classified the principal behaviors which can occur, using the EA model as our 
prototype. Among the scenarios are possibilities 3-5, which are quite unlike any of the 
standard pictures. 

Another new scenario (possibility 6), referred to as the "nonstandard SK picture", max- 
imizes the features of mean field behavior that might survive in short-ranged models despite 
the elimination of the standard SK picture in Ref. |jl3[. In this picture, the thermodynamic 



state p'j on all replicas for fixed J can be written as an integral, over the F's of n{J), of in- 
dependent F-distributed replicas (see Eq. (^). Each F would be a weighted sum, ^rPj^ 
from a countably infinite family of pure states, but the integral (given by k) would be over 
a continuum of choices of these families (as well as over the weights for each family), all for 
a fixed J^. The measure k prescribes the probability of obtaining both a particular family 
of pure states and their weights. This probability corresponds to selecting the family (and 
weights) according to p^^^ with L large and chosen at random (but with JT" fixed); each 
different choice of L will in general select out a different family of pure states. 

If such a picture holds, some familiar mean-field behavior would be exhibited in short- 
ranged models. In particular, one would find dominance of a few states in large finite 
volumes (but with the family from which they're chosen changing chaotically with volume). 
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A restricted (within F) ultrametricity of overlaps is not ruled out, but the countable nature 
of each F places strong constraints on the nature of the metastate. 

We emphasize that the nonstandard SK picture differs from the usual one in important 
respects. In particular, there is no dependence of overlap distributions on JT", but only on 
the state F within k. Also, ultrametricity would not hold in general among any three pure 



states [T^, but would be valid only for states from the same F. 

We have previously shown that short-ranged models display non-mean-field behavior; 
i.e., the existence of a jT-dependent state pj with jT-independent overlaps. If some of the 
more familiar mean-field properties are nevertheless to hold for the thermodynamic states, 
then something like our nonstandard SK picture must be present. But this picture is very 
heavily constrained. The probability distribution on weights of pure states and their overlaps 
cannot change with J] in particular the distribution on weights must be invariant with 
respect to any changes of any finitely many couplings. Whether this is reasonable can be 
judged by the reader; whether it will survive must be determined by future work. 
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